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(57) Abstract: The invention 
relates to an ultrasonic image 
processing mediod having stq)s of: 
acquiring ultrasonic signals related 
to an object having nx>ving parts in a 
medium; constnicting an ultrasonic 
grayscale 2-D image sequence 
representing a cross-section of 
a segment of the object with 
respect to a longitudinal axis (X) 
perpendicular to the grayscale 
image lines (Z); estimating the 
displacements and the disfdaoement 
gradients of a boundary of the object 
and : normalizing the gray levels in 
a boundary zone and color<oding 
the points of the boundary zone of 
the an image sequence in function 
of the displacement gradient values, 
in order to provide color-coded 
information of the object moving 



parts displacement variations. Ibe invention also relates to an nltcasonic examination imaging system for carrying out said method 



having a color display Systran. 
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^L^f^o^"^ PROCESSING METHOD AND SYSTEM FOR DISPLAYING AN ULTRASONIC 

COLOR-CODED IMAGE SEQUENCE OF AN OBJECT HAVING MOVING PARTS 



DESCRIPTION 

The invention relates to an ultrasonic image processing method for displaying 
an ultrasonic examination color-coded image sequence of an object having moving parts in a 
medium. The invention also relates to an ultrasonic examination imaging system for carrying 
out this mediod. 

The invention is used in the field of ultrasonic diagnostic imaging, for 
providing cardio-vascular non-invasive diagnostic tools for studying anomalies of arteries 
and notably stenoses. A basic diagnostic criterion for a stenosis is an abrapt reduction of the 
diameter of a suspect artery segment observed in an artery image. A more elaborate criterion 
is the study of tiie artery wall displacements in function of the instants of the canUac cycle 
and in function of the location along die artery segment. Therefore, in onier to early 
diagnosing stenosed arteries, tiie medical field has a need for non-invasive means for 
providing art€ry images together with readily visible indications related to the arterial wall 
displacements. 

An ultiasonic image processing metiiod for calculating wall displacements of 
an artery segment is already known from the patent US-05.579,771 (Bonnefous, Dec. 3, 
1996). This document describes a method for characterizing an artery segment by ultrasonic 
imaging, using an array of ulu-asonic transducers that produces a sectional frame, which is 
formed by image lines of a number of successive parallel excitation lines extending 
perpendicularly to the artery axis. Said array is coupled to a transmitter/receiver circuit, 
which provides high frequency signals to a signal pn)cessing system Said system deteimines 
the arterial wall velocities and displacements, in tiie arterial radial direction Z, at a given 
location corresponding to an excitation line along tiie longitiidinal X-axis of Uie artery, in 
function of excitation instants t. during a catdiac cycle. So. HG.l of tiiis document shows a 
25 system in a block diagram fonn. apt to cairy out tiiis metiiod. 

So, under tfie influence of tiie pulsating wave of tfie blood in tiie artery during 
a cardiac cycle, tiie walls of tiie artery are subject to periodic radial movements whose 
amplitude and velocity can be determined. Depending on the state of tiie arterial walls, tiie 
pressure variations induced by tiie pulsating wave create eitiier a unifonn arterial dilatation or 
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distorted parietal movements. Evaluating the distortions or non-distortions of the artery walls 
pemuts of deriving the presence and seriousness of stenosis, or elasticity defects, in real time, 
enabling optimization of the diagnosis. To that end, it is important to obtain information 
about the arterial wall movements and it is still more important to obtain information about 
5 the wall movement variations, i. e the movement gradients. 

So, a problem lies in the fact that the movement gradients are not readily 
exploitable by a cardiologist. Not only the arterial wall movement variations must be made 
easily available and exploitable, but also, concomitantly, a standard grayscale image of the 
corresponding artery segment must be displayed, in order to perform a successful study and a 
10 precise diagnosis of the suspect zone of artery. 

Now, a further problem lies in the fact that the gradient information, which is 
to be further added to the grayscale image, must not make this grayscale image unreadable. 

Theses problems are solved by means of a method as claimed in Claim 1 . 

An advantage of this method is that the arterial wall behavior is made clearly 
15 visible together with the gradient information that is strongly related to arterial wall lesions 
and is most useful to establish the diagnosis. An other advantage is that non-invasive means 
are used, which permits of avoiding modification of the artery pressure, hence the actual wall 
movements, as would be the case using invasive means . 

An ultrasonic diagnostic system having means for carrying out the method is 
20 claimed in Claim 7. 

BRIEF DESCRIPTION OF THE HGURES 

Specific embodiments of the invention will be described in detail hereinafter 
with reference to the accompanying diagrammatic drawings ; therein : 
25 FIG. 1 A, IB, IC show block diagrams of an ultrasonic diagnostic imaging 

system for carrying out a color-<:oded image sequence construction method; 

FIG.2A and 2B show respectively artery wall displacement and displacement 
gradient curves; and FIG.2C illustrates the construction of a color-coded image; 

FIG.3 shows an image constructed using the method. 



30 



DESCRIPTION OF THE PREFERED EMBODIMENTS 

Referring to FIG.IA and IB, an ultrasonic diagnostic imaging system,. shown 
in a block diagram form, is used as a tool for the examination of an artery 7 located in a 
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medium 8 and comprises sub-systems 1, 100. 200 to perfonn an image processing method for 
• the construction and display of a sequence of images, which pennits of visualizing together : 
an arterial segment whose walls have radial displacements occuning under the 
influence of the blood pressure, in function of the different time instants of a cardiac cycle. 
5 and color-coded infonnation related to the displacement variations along the 

longitudinal axis of the artery, as illustrated by FIG.3. 

Referring to HG. lA and nO.lB, this image processing method comprises a 
step 1 of acquiring ultrasonic signals related to the artery segment, said artery segment 
having a longitudinal axis denoted X-axis and a radial axis denoted Z-axis. a step 100 of 
10 determining the arterial wall displacement gradients and a step 200 of constmcting and 
displaying a sequence of color-coded images comprising a display of a grayscale image 
sequence representing said artery segment, in which specific zones of the arterial walls, are 
. color-coded in function of the values of the wall displacement gradients. In the sequence of 
• color-coded images, which is registered during a whole cardiac cycle, each image is acquired 
15 at a given instant n of said cardiac cycle. 

The grayscale sequence images show that each arterial wall has radial 
displacements denoted D(Z.X.n). from one image to the other; it means that a point situated 
on the internal boundary of the waU. at a given location X. is submitted to a displacement 
along the Z-axis. The color-coded representation of the specific zones of the walls, preferably 
20 in red. gives the information constituted by the local wall displacement variations, meaning 
the variation A of the estimated radial displacements D(Z.X,n) around said location X. 

Refening to HGIA and IB, the method of forming the sequence of ultrasonic 
color-coded images by fonning an ultrasonic grayscale image sequence of the moving artery, 
where the zones of high movement gradients related to local high strains in the arterial walls 
25_ are displayed in color, for example red. comprises the particular steps of : 
acquisition 30 of the ultrasonic gray image sequence; 
segmentation 62 of the gray image sequence to identify the arterial walls by 
deteimining transition lines 3a, 3b between the interior of the artery and the artery walls; 

computation 68. 69 of the arterial wall displacements D(Z,X,n) at each instant 

computation 71,73 of the wall displacement gradients A =d(D)/dX at each 

niustrated by nG.2C. this method further comprises a step 140 performing the 
normalization of the gray images on the location of arterial wall in order to solve a problem 
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lying in that the ultrasonic grayscale image must remain visible when the specific zones are 
colored; this step comprises sub-steps of making whiter the boundary zones of the artery 
walls and assuring sufficient transparency of the colored zones, wherein : 

evaluation of ribbon-shaped zones PI, P2 spanning both sides of each 
5 transition line 3a, 3b, for instance 1 mm each side, diat is 2mm wide and computation of the 
mean gray values denoted G„Kan for each pixel in the ribbon-shaped zones, which is 
perfonned by evaluating the mean gray value on each excitation line L parallel to the Z-axis 
in said zones; 

estimation of new gray values G for each pixel in the ribbon-shaped zones PI, 

10 P2, based on the original gray values denoted Go, taking into account the mean gray values 
Gb««. in order to reinforce the white in said zones, for example using the following formula 
in an image supposed to have 256 gray levels : G.= 128 (Go / G„^). As G is made larger, the 
image in made whiter in the ribbon-shaped zones. 

Illustrated by FIG.3, the step 140 of the method further performs coloring the 

15 points in said ribbon-shaped zones PI. P2 in function of tiie displacement gradients. Before 
coloring the zones, the gray value of each point results of the association of tiuee color 
components as follows : G = V = B = R where G is for gray. V for green, B for blue and R 
for red. For coloring of the gradient zones, tiie level of each color component is modified as 
follows : R = G, V = G ( 1 - A/256), B = G (1 - A/256), if the number of gray-levels is 256. so 

20 as a point in the boundary zone has a color C given by associating the new levels of the 
components R. V, B. Other color-coding methods are possible to those skilled in the art. 
However, the proposed method gives good results for studying tiie displacement variations 
based on the display of the artery grayscale images v/ixh color-coded wall displacement 
gradients. HG.3 illustrates a resulting image by representing tiie different color-coded zones 

25 by different striped zones Ql to Q7, corresponding to different displacement gradients. 

FIG.IA shows ttie ultiasonic diagnostic imaging system for tiie formation and 
display of tiie sequences of composite images as above-described, comprising the display of 
grayscale images witii color-coded information of tiie movement gradients of the artery walls 
over at least one caitUac cycle. So, tfiis ultirasonic diagnostic imaging system constitutes a 

30 tool for tiie diagnosis of lesions of arterial walls. This ulti:asonic diagnostic imaging system 
comprises sub-systems 1, 100, 200. 

Referring to Fig.lA, tiie operation of the sub-system 1 involves an ultrasonic 
probe 10 in contact witii the medium 8 observed. The ultrasonic probe 10 transmits, via 
periodic excitations, ultrasonic signals to tiie medium scanned, in a direction OZ, and 
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receives, in the same direction OZ, the echoes returned by the obstacles encountered in the 
medium. The probe is preferably composed of ultrasonic transducers which are assembled in 
a linear array parallel to the X-axis, A respective excitation line coiresponds to each 
transducer. 

5 Referring to Fig, IB, the examination of the medium by the ultrasonic probe 10 

is performed in such a manner that the artery 7 is scanned longitudinally in the direction 
parallel to OX in order to obtain longitudinal cross-sectional intensity images, enabling the 
visualization of the front wall 2a and the rear wall 2b. The direction of the transducer array is 
represented by the direction OX and the direction of the excitation lines is represented by tiie 
10 direction OZ. Therefore, the echographic image is scanned along the excitation lines of 
direction OZ which are die columns of the image. The probe is connected in 19 to an 
emitter/receiver stage 20. In a transmission step, the medium is scanned along the directions 
of tfie excitation lines. In a receiving step, die image of each excitation line is formed, taking 
into account tiie propagation time in the medium and die amplitude of die echoes returned by 
15 the obstacles encountered along the excitation line considered. Preferably, in order to obtain a 
suitable resolution for tfie image, the ultrasonic excitations are focused during transmission as 
well as reception. The emitter/receiver stage 20 provides acoustic high-frequency signals 
S(X,Z,n) which enable the formation, as a function of die instant n, of a sequence of intensity 
images I(X,Z,n) by way of an operation 30, n being the number of die image of the sequence. 
20 Each intensity image I(X,Z,n) 21 is thus formed by the scanning of the excitation lines of the 
probe. The behavior of the artery is observed at least over a full cardiac cycle. Therefore, a 
sequence of a number N of images covering a time interval which is at least equal to a 
cardiac cycle is formed, N being a number 1 ^ N. The number of image excitation lines may 
be, for example 68 or 112 widi a scanning step (distance between excitation lines) of 0.5 mm 
25 or 0.25 mm. These characteristics enable visualization of an arterial segment of 28 mm. 

Refeiring to FIG.IA, die intensity images I(X^,n) 21 referred to as grayscale 
images are stored in an image memory 50 denoted Cineloop for further construction of die 
display of color-coded iniages. For die evaluation of die displacement gradients, it is 
necessary to detennine die velocity and the amplitude of the displacements of die walls. 

The sub-system 100 includes a processor which executes die steps of 
processing die high-frequency signals S(X,Z,n). The sub-system 100 first performs a 
temporal correlation operation 120. The successive ultrasonic echoes are compared by way of 
dieir correlation function. The displacement of die biological structures from one ultrasonic 
emission to the next is estimated while taking into account the displacement of the correlation 
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peak corresponding to the delay introduced by this displacement upon reception. For all 
objects scanned, the correlation operation 120 provides velocity measurements in the form of 
two-dimensional velocity images V(X,Z,n) denoted 121. The correlation function is 

performed between the images^of the image sequence^ a ratfier large memory 119 denoted 

5 MEM3 must be available at the input of the module 120 performing the correlation operation 
for providing the necessary delay between two correlated signals. 

Besides the velocity images 121 V(X,Z,n), echo amplitude images 111 
A(X,Z,n), used as segmentation means, are also necessary to perform the further extraction 
and localization of the parietal velocities of the two-dimensional velocity images. These 
10 amplitude images 1 1 1 A(X,Z,n) are obtained, in the sub-system 100, by means of an 

. amplitude measurer 1 10. The memory 122 called MEMl and the memory. 1 12 called MEM2 
store the results of the sub-system 100, which are respectively the velocity images V(X,Z.n) 
and the echo amplitude images A(X,Z,n). 

Referring to FTG.IC, the sub-system 200 comprises a processor, which 
15 executes the post-processing operation 130 applied to the results of the preceding operations 
1 10 and 120 in order to detennine the upper and lower wall displacements respectively 
Dl(X,n) and D2(X,n), and the corresponding displacement gradients Al(X,n), A2(X,n). The 
operation 130 comprises steps of : 

application 62 of an adaptable threshold for each amplitude image 111 
20 A(X,Z,n) in order to perform the identification of the internal parietal boundary of the artery : 
this threshold produces digital images with black/white transitions between the interior and 
the exterior of the artery corresponding to the lower and upper internal parietal boundaries 
3a, 3b; these transitions are filtered to eliminate discontinuities; 

determination 63 of the respective thickness of each arterial walls. In the 
25 current implementation, a thickness value amounts to approximately 1 nun; determination 66. 
67 of an average value of the velocities through the thickness of the arterial wall, for example 
throu^ the given thickness of 1 mm; 

determination 68, 69 of the displacements Dl(X,n) and D2(X,n) between each 
image, related to each wall, by a temporal integration, such as shown by the curve of FIG.2A; 
30 and determination of the corresponding displacement gradients A 1 (X,n), A2(X,n) for each 
wall, calculated by an adder 71 as the difference between two displacement values, such as 
shown by the curve of FIG.2B. 

After corrections in 73, taking into account the starting instants nl, n2 of the 
cardiac cycles determined in 72, where die artery has zero parietal displacements, the display 
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sequence images, as shown in nG.3, are constructed by the module 140, which constnicts 
the color-coded zones corresponding to the parietal displacement gradients Al(X,n), A2(X,n) 
at the instant n in the grayscale images I(X,Z,n) fetched from the memory 50 Cineloop. 

Referring to HG.IA, the ultrasonic processing system also comprises an 
interface 170 for the user to control the display of the images of the sequence in function of 
the time instants n. The display system, the processors and the memories may respectively be 
the screen 40, the processor 130 and the memory of a workstation as known of diose skilled 
in the art. The workstation may also comprise a keyboard and a mouse used as an interface 
for the user to control the image of the screen. A color display system is used to display the 
color-coded zones. 

The invention can be applied to the processing of signals different from 
ultrasonic signals, for example electric, electromagnetic signals, etc, and to the pix)cessing of 
other objects other than an artery, for example objects having moving parts with regularly 
recurring displacements. During the display of the sequence on the display device 40, the 
physician can qualitatively and quantitatively evaluate the distortions or non-distortions of 
the displacements of the walls and derive therefrom the presence and the seriousness of 
stenosis, or elasticity defects, linked to the arterial walls of the subjacent grayscale image, in 
real time, which enables optimization of the diagnosis. 
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CLAIMS: 



1. Ultrasonic image processing method comprising steps of : 

acquiring ultrasonic signals related to an object having moving parts in a 
medium; constructing an ultrasonic grayscale 2-D image sequence representing a cross- 
section of a segment of the object with respect to a longitudinal axis (X) perpendicular to the 
5 grayscale image lines (Z); estimating the displacements and the displacement gradients of a 
boundary of the object and : 

normalizing the gray levels in the boundary zone and color-coding the points 
of the boundary zone of the image sequence in function of the displacement gradients, in 
order to provide color-coded information of displacement variations the object moving parts. 

10 

2. A method as claimed in Claim 1, wherein the grayscale image normalization 
step comprises sub-steps of segmentation of the grayscale images to determine a boundary 
transition line, estimation of the boundary zone as a zone spanning each side of the boundary 
transition line, estimation of the mean gray (Gmcan) level in the boundary zone and calculation 

15 of new gray values (G) for the points of die boundary zone, based on the estimated mean gray 
values and on the original gray values (Go), which are in average whiter than the original 
gray values. 

3. A method as claimed in Claim 2, wherein the new gray values G for the points 
20 of the boundary zone are estimating using the following relation : G = 128 (Go / Gmeao) where 

Go is the original gray value and Gmcan is the mean gray value on the corresponding line of 
the grayscale image in the boundary zone. 

4. A method as claimed in Claim 2 or 3, wherein the color-coding step comprises 
25 sub-steps of estimating the new color of the points in the boundary zone by varying the levels 

of the color components ( R, B, V) of the new gray color levels (G) at said points in function 
of the displacement gradients (A). 
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5. A method as claimed in Claim 4, wherein, each gray point being formed by 

association of three color components as follows : G = V = B = R where G is for gray, V for 
green, B for blue and R for red. the levels of each color component is modified and the new 
levels are given by the following relations : R = G, V = G ( 1 - A/256), B = G (1 - A/256), if 
the number of gray-levels is 256, so as a point in the boundary zone has a new color C. 
preferably in the red, given by associating the new levels of the components R, V, B. 

6. A method as claimed in any one of Claims 1 to 5, wherein the object is an 

artery, the moving parts are the artery walls moving under the blood pressure, the 
displacements arc periodic due to the cardiac cycles, the grayscale image longitudinal axis 
(X) is the artery axis, the displacements are the radial arterial displacements and the gradients 
of wall displacement are color-coded, preferably in red, to provide information on the arterial 
wall displacement variations. 



^- '^"'t^nic examination imaging system to carry out a method according to 

• any of the preceding Claims, comprising an ultrasonic probe coupled to an ultrasonic system 
for emitting and receiving ultrasonic signals from a medium with an object having moving 
parts, and comprising ultrasonic sub-systems to process the received ultrasonic signals with 
processors to construct the color-coded images, memories to store the images, a display 
system to display the color-coded images formed by following the steps of said method. 

8- A system as claimed in Claims 7, wherein the display system is a color 

system. 



^- A system as claimed in one of Claims 7 or 8, comprising a suitably 

programmed computer of a workstation or a special purpose processor having circuit means, 
which are arranged to process ultrasonic signals according to the method, said system having 
means to display die images constioicted according to said method, and having an user 
interface such as a mouse or a keyboard to permit the user of controlling the display. 

30 



10. A computer program pnxiuct comprising a set of instmctions for carrying out 

a method as claimed in one of Claims 1 to 6, 
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